Skip to content

Conversation

@original-brownbear
Copy link
Contributor

  • Cleans up all root level temp., snap-%s.dat, meta-%s.dat blobs that aren't referenced by any snapshot to deal with dangling blobs left behind by delete and snapshot finalization failures
    • The scenario that get's us here is a snapshot failing before it was finalized or a delete failing right after it wrote the updated index-(N+1) that doesn't reference a snapshot anymore but then fails to remove that snapshot
    • Not deleting other dangling blobs since that don't follow the snap-, meta- or tempfile naming schemes to not accidentally delete blobs not created by the snapshot logic
  • Follow up to Recursively Delete Unreferenced Index Directories #42189
    • Same safety logic, get list of all blobs before writing index-N blobs, delete things after index-N blobs was written

backport of #43542

* Cleans up all root level temp., snap-%s.dat, meta-%s.dat blobs that aren't referenced by any snapshot to deal with dangling blobs left behind by delete and snapshot finalization failures
   * The scenario that get's us here is a snapshot failing before it was finalized or a delete failing right after it wrote the updated index-(N+1) that doesn't reference a snapshot anymore but then fails to remove that snapshot
   * Not deleting other dangling blobs since that don't follow the snap-, meta- or tempfile naming schemes to not accidentally delete blobs not created by the snapshot logic
* Follow up to elastic#42189
  * Same safety logic, get list of all blobs before writing index-N blobs, delete things after index-N blobs was written
@original-brownbear
Copy link
Contributor Author

Jenkins run elasticsearch-ci/1

1 similar comment
@original-brownbear
Copy link
Contributor Author

Jenkins run elasticsearch-ci/1

@original-brownbear original-brownbear merged commit 2768662 into elastic:7.x Jul 11, 2019
@original-brownbear original-brownbear deleted the 43542-7.x branch July 11, 2019 17:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant